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accordance with potential environmental events. 
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SYSTEM AND METHOD FOR THE AUTOMATIC CONTROL OF 

VIDEO FRAME RATE 



RELATED APPLICATIONS 
5 This application claims priority from US provisional patent 

application number 60/324,056 titled "AUTOMATIC CONTROL OF VIDEO 
RATE" filed September 24, 200 1 . 

BACKGROUND OF THE INVENTION 
! o FIELD OF THE INVENTION 

The present invention relates in general, to video surveillance and 
video storage systems and more specifically, to a system and method for 
automatically controlling the video frame rate of video streams. 

fj 

! 5 DISCUSSION OF THE RELATED ART 

Many applications in the field of video surveillance and video storage 
require the transfer of video data such that the video frame rate is specifically 
controlled. These applications should typically involve an input process to 
generate video frames at the basic rate of the input process, and an associated 

20 output process, which requires video frames at a rate specifically required by the 
output process. Video frame rate adaptation is required in the video surveillance 
and storage field to solve several basic implementation issues. 

Surveillance systems require the ability to view video clips either in 
real time where the data is available substantially simultaneously with an actual 

25 recording or off-line by utilizing previously recorded video data, which is 
typically stored in a local or remote archive. The best-known and available 
communication media for remote video viewing is the Internet. Access to a 
plurality of video files stored across the Internet is readily provided by 
substantially any standard computing device. To access, to transfer and to view 

30 video via from the Internet does not require specific installations of unique 
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hardware or software components. Standard Web browser utilities, such as the 
Internet Explorer or the Netscape Navigator, which is typically pre-installed in 
the majority of computing devices, and similarly pre-installed standard widely 
available communication devices, such as modems or network interface cards, 
5 provide ready accessibility to video images over the Internet. 

The drawback of utilizing the Internet as a source media and a transfer 
media for the transfer and the viewing of video files concerns the lack of Quality 
of Service since there is typically no guarantee for a fixed-rate transmission 
bandwidth availability. Currently, the transmission rate of the data during 

10 Internet sessions fluctuates significantly. Thus, the attempts to achieve a pre- 
determinedly fixed transmission data rate for viewing pre-determinedly fixed 
frame rate video is not practical. 

Video information archiving requires relatively high storage capacity. 
In the surveillance field, when video recordings, captured by a plurality of Close 

15 Circuit Television (CCTV) video cameras, needs to be archived for substantially 
extended periods, the required storage capacity might become a considerable cost 
issue. As a result, in many situations it would be economical to control the size of 
the required storage space by adjusting the archived video frame rate to the 
availability of the storage space. 

20 . Surveillance systems are characterized by the necessity to provide 

alarm signals and dynamic recording functions for identified events that typically 
occur at rare instances. In a surveillance system an event constitutes an electronic 
trigger generated by some device that senses disturbance in the environment. An 
event might be generated for example, by the opening of a door or a window in 

25 the environment under surveillance, which is captured by a movement-sensing 
device or by a video motion detector. Most of the time, the systems monitor a 
substantially static environment, which does not provide significant event- 
specific information. Thus, for extended periods the surveillance systems operate 
typically in a "wait-state" during which continuous attempts are made in order to 

30 identify critical events. It is imperative that critical events would be recorded and 
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that simultaneously generate an associated alarm signal. When a critical event 
occurs, the recording of the video needs to be performed with the highest 
possible quality. In the "wait-state", during the substantially static or "quite" 
periods, a lower recording rate, requiring less storage space, could be activated in 

5 order to provide a better trade-off. 

One obvious solution might be to switch to a higher recording rate 
when the event happens. The drawback of this solution is that an inevitable 
minor delay between the event and the start of the high recording rate could 
effect the missing of some of the important information that is in the video 

10 images representing the event occurrence. 

Surveillance systems often require the capability of monitoring the 
same video source, such as a video camera, where the recording is to be 
transmitted to several viewers, where each viewer is having its own bandwidth 
viewing capability in accordance with the respective communication devices, 

15 communication lines, location, viewing apparatus and the like. When using 
conventional analog CCTV cameras, the multi-monitoring capability is usually 
provided via amplifiers, splitters, and coaxial cable routing the signal to the 
various users. When using video cameras having digital (Web enabled) output 
(typical example is model # 2420 manufactured by AXIS Communications of 

20 Lund Sweden), the distribution of the video to several viewers is more 
problematic. One solution might be the use of multi-cast IP massages that are 
routed to the users that are in the addressee list of the multi-cast massage. The 
drawback of this solution is that all the users will get the same information rate 
that will have to be reduced to the lowest common denominator. 

25 
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SUMMARY OF THE PRESENT INVENTION 
One aspect of the present invention regards a system for the automatic 
unit rate control of an information units stream, the system comprising an 
information units stream processor device to receive at information units stream 
5 from an information units stream generating device, to selectively control the 
outputted unit rate of the information units stream and to output the unit rate 
controlled information unit stream to an information units stream display device. 
The information unit stream processor device further comprises the elements of 
an inputted information units stream having a pre-defined unit rate and carrying 

10 distinct information units; an input handling entity to receive the inputted 
information units stream and to store selectively the information unit into a 
storage area; a storage area to hold the information unit received from the input 
handling entity; an output handling entity to obtain the information unit from the 
storage area to regulate the unit rate of the information units stream and to output 

15 the information units stream; and an information unit rate control mechanism to 
provide automatic unit rate control in order to regulate the unit rate of the 
outputted information units stream. The information unit stream is inputted from 
the information units stream generator device. The information units stream is 
outputted to an information unit stream display device. The information units 

20 stream include rich media. The information units stream can be a video stream. 
The information unit can be a video frame. The information unit stream generator 
device can be a surveillance video camera device. The information units stream 
display device can be a surveillance video monitor. The information units stream 
processor device can be a video rate processor device. The video rate processor 

25 device is operative in the selective unit rate control of a video stream received 
from a surveillance video camera via the communication media and forwarded to 
a surveillance video monitor via a communication media. The input handling 
entity can be a standalone hardware device. The input handling entity is a 
software routine implemented in a computing device and running within the 

30 processor of the computing device. The output handling entity is a standalone 
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hardware device. The output handling entity is a software routine implemented in 
a computing device and running within the processor device of the computing 
device. The unit rate control of the outputted information units stream is further 
regulated internally by an in-built timing mechanism associated with the output 

5 handling entity. The unit rate control of the outputted information unit stream is 
further regulated by the pre-defined characteristics of the output handling entity. 
The unit rate control of the outputted information units stream is further 
regulated by the pre-defined characteristics of the communication media. The 
storage area can be implemented on a media storage device. The media storage 

10 device can be a hard disk device. The media storage device can be a tape device. 
The media storage device can be a DVD device. The communication media can 
be the Internet or an Intranet or a wireless communications network or a 
telephone network or a local network or a wide area network or a cellular 
network. 

IS A second aspect of the present invention regards a method for the 

automatic unit rate control of an information units stream, the method comprising 
the steps of receiving an information units stream having a pre-defined unit rate 
from an information unit generator device via a communication media by an 
input handling entity; storing an information unit from the information units 

20 stream into a storage area by the input handling entity; reading the information 
unit from the storage area by an output handling entity, and controlling the 
operation of an output handling entity by an unit rate control mechanism to 
provide for a specific unit rate of the outputted information units stream. The 
method further comprising the step of outputting an information units stream 

25 having a controlled specific unit rate by the output handling entity to an 
information units stream display device via a communication media. The unit 
rate of the outputted information units stream generated by the output handling 
entity is controlled by an in-built timing mechanism associated with the output 
handling entity. The unit rate of the outputted information units streams is further 

30 controlled the pre-defined characteristics of the output handling entity. The unit 
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rate of the outputted information units streams is further controlled the pre- 
defined characteristics of the transmission media. 

A third aspect of the present invention regards a method for 
generating a plurality of information units streams, provided with diverse unit 
5 rates, from a single information units stream having a pre-defined unit rate and 
distributing the plurality of the information unit streams, the method comprising 
the steps of inputting the information units stream from an information units 
stream generator device to a plurality of information units rate control devices; 
controlling the operation of the plurality of information units rate control devices 

10 via a plurality of unit rate control mechanisms in order to provide diverse unit 
* rates to a plurality of outputted information units streams; storing the plurality of 
outputted information units streams into a plurality of data storage files 
associated with a media storage device thereby creating a plurality of information 
units stream data storage files with variable unit rate characteristics. The method 

15 further comprises transmitting the plurality of data storage files to a plurality of 
information units stream display devices in accordance with the available 
bandwidth associated with the display devices. The process of the data storage 
file generation is automatically controlled by and associated with the occurrence 
of an environmental event. The transmission of a specific data storage file to the 

20 information units stream display device is controlled by and associated with the 
occurrence of an environmental event. The transmission of the data storage files 
storing information units streams having diverse unit rate characteristics to the 
information units stream display device is controlled by and associated with the 
occurrence of an environmental event. The occurrence of the environmental 

25 event and the lack thereof effect pre-defined, content-specific, unit-rate-specific 
and timed interactions among the data storage files. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
The present invention will be understood and appreciated more fully 
from the following detailed description taken in conjunction with the drawings in 
which: 

5 Fig. 1 is a schematic illustration of the Video Rate Processor, in 

accordance with a preferred embodiment of the present invention; 

Fig. 2 is a schematic illustration of controlled archiving rate 
application, in accordance with a preferred embodiment of the present invention; 
and 

10 Fig. 3 is a schematic illustration the multi -track video archiving 

application, in accordance with a preferred embodiment of the present invention. 



15 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 
The proposed invention describes a system and method that 
automatically provides the video frame rate required and supported by an output 
device out of a set of the video frames generated by an input device, while 
5 maintaining the integrity of the video information. In the preferred embodiment 
of the invention the system and method is designed and developed for use in 
surveillance systems. In other preferred embodiments the proposed system and 
method could be used for different purposes. 

The proposed system and method enables reception of meaningful 

10 video images, in real time, from local archives or from remote archive through 
the Internet, using an automatic video frame rate control. The system and method 
enables adaptive modifications in the rate of transmitting the video frames in 
accordance with the available bandwidth. 

The proposed system and method enables the controlled archiving rate 

15 while maintaining high real-time video frame rate, which provides high-quality 
real-time video viewing capability with reduced archived quality for a lower 
storage costs. The incoming video stream is recorded onto an archiving media 
and generates one or more video files thereon. The type of the archiving media 
could include but is not limited to a tape drive a hard disk or the like. The video 

20 files are recorded using different frame rates by utilizing an automatic frame 
control method. Thus, a first file could keep a recording of the video stream with 
a low frame rate and a second file could record the video data with a higher 
frame rate. The first file having a low frame rate is stored on a storage device for 
an extended period. The second file is having a high frame rate and it is stored 

25 for a substantially limited period (typically less than an hour). The second file is 
continuously and dynamically updated by deleting of "old" video frames to free 
storage space for the insertion of "new" video frames. When a specific event 
occurs, the video frame deletion process regarding the second file is suspended, 
and the high frame rate video stored in the second file is available for monitoring, 

30 prior to the event, through the event and after the event. The process enables 
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It 

storage of video data for longer periods at a low frame rate while maintaining the 
possibility of monitoring high frame rate video data during specific events 
without the need to occupy in a pre-defined manner large and costly storage 
spaces. 

5 The proposed system and method allows for the reproduction of the 

video stream at various video frame rates where the storage of the stream is 
dynamically tuned to the specific requirements of a user and/or the capabilities of 
the user's device. 

A video frame is single electronically captured picture by a video 

10 camera. Video streams usually constitute consecutive frames captured by the 
camera at a rate of 30 or 25 frames per second. The concept of the proposed 
system and method is based on the fact that a video signal is composed of a 
plurality of video frames where each frame constitutes a complete information 
package representing an autonomous data element. 

15 Referring now to Fig. 1 that describes the operation of the Video Rate 

Processor (VRP) 10. The VPR 10 comprises an Input Video Stream (IVS) 11, 
one or more Input Processes/Input Devices (IP/ID) 12, one or more Most Recent 
Frame Buffers (MCFB) 14 and one or more Output Processes/Output Devices 
(OP/OD) 16. An Input Video Stream (IVS) 11 is fed into the suitable IP/ID 12. 

20 The IVS 11 could be a communication line into a processor or a software 
interface installed in a computing device. The IVS 11 is composed of video 
frames that enter the Input Process/Input Device 12 (IP/ID) where the stream is 
parsed in order to build a set of the unique autonomous video frames. The IP/ID 
12 could be implemented as a stand-alone processor or a computer program that 

25 runs on a processor device in which the preferred embodiment of the present 
invention is implemented. The IP/ID 12 stores continuously the last received 
frame of the IVS 11 into a temporary storage of the MRFB 14. The MRFB 14 
includes several buffer storage areas where each area contains a single 
autonomous frame. The MRFB 14 is implemented such that substantially 

30 simultaneous writes by the IP/ID 12 and substantially simultaneous reads by the 
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OP/OD 16 are enabled. The temporary buffer storage might be implemented on a 
computer RAM hard disk or any other storage device. The connection between 
the IVS 1 1 and the MRFB 14 could be implemented through the performance of 
a common access/store/seek/retrieve command interface in a computer or 
5 through a special hardware interface to a memory device. 

Still referring to Fig. 1 one or more OP/OD 16 are linked to the 
MRFB 14 in order to obtain the most recently stored video frames from the 
suitable buffer areas. The OP/OD 16 accesses and reads the appropriate data via 
pre-defined, suitably coordinated and properly timed procedures. The connection 

10 from the OP/OD 16 to the MRFB 14 can be implemented by a standard computer 
read/write command interface or by a special hardware interface. The OP/OD 16 
delivers output video streams (OVS) 17 17" and 17'" composed of the 
concatenated video frames. The OP/OD 16 could be implemented as a stand- 
alone processor or a specifically designed and developed computer program that 

15 runs on a processor in which the preferred embodiment of the invention is 
implemented. The OVS 17 could be a communication line from a processor or a 
software interface within a computing device. The rate at which the OP/OD 16 
reads the MRFB 14 can be controlled by an external rate control input (RC) 18, 
by an internal rate control mechanism, or by the OVS 16 own pre-determined 

20 data rate. In the first case an external interface tasks the OP/OD 16 through the 
' RC 18 interface to extract and send the data from the MRFB 14 to the OP/OD 16. 
*' In the second case an internal fixed rate mechanism generated from an internal 
clock device within the processor tasks the OP/OD 16. In the third case the 
OP/OD 16 sends the video frames through the OVS 17 interface at its own pre- 

25 defined frame rate. Consequent to the completion of the sending of the data by 
the interface (some buffering may be implemented), the OP/OD 16 reads the 
MRFB 14 repeatedly in order to obtain and send a new frame. In this case the 
process adapts the video frame rate to instantaneous bandwidth of the OVS 17. 
Each of the OP/OD 16 could be provided with its own independent frame rate 
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control mechanism and could deliver the data to the OVS 17 at its own 
independent and pre-defined rate. 

Still referring to Fig. 1 when the recorded video data is transferred for 
viewing over the Internet the following process is performed. The video rate 

5 processor (VRP) 10 receives video streams from CCTV cameras or from 
archived video files and transmits the streams to the Internet through the OVS 
17', 17" and 17"'. The processor 10 adapts itself to the available bandwidth of 
the Internet by reading the MRFB 14 consequent to the sending of the previous 
frame. The indication that the previous frame was sent is received from the 

10 TCP/IP protocol implemented in the processor and commonly used to transmit 
data over the Internet. 

Referring now to Fig. 2 that illustrates a controlled archiving rate 
application in accordance yvith a preferred embodiment of the present invention. 

15 The application enables storing of video data at a low rate to preserve storage 
while enabling the viewing of real-time video at a high rate. In the preferred 
embodiment of the invention an Input Video Stream (IVS) 21 feeds two Video 
Rate Processors (VRP) 10' and 10". The first VRP 10' is connected to the 
storage device 24 and receives rate control commands 18 from the controlling 

20 system, which determines at what rate should the video frames be recorded. The 
second VRP 10" controls the transmission of real time video at the Output Video 
Stream (OVS) 26, adjusting it to the required rate or to the available bandwidth 
of the OVS interface 26. 

25 Referring now to Fig. 3 that illustrates a multi-track archiving of video 

application. The application enables storing of video at two different rates. The 
higher rate is used for storing video for a limited duration to enable a viewing of 
high quality video in case of an event occurring. The lower rate is used for 
storing video for extended durations in order to effect substantial saving of 

30 storage space. In the preferred embodiment of the invention, an Input Video 
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Stream (IVS) 31 feeds two VRPs 10'" and 10"". Each VRP has its own Rate 
Control (RC) input 18' and 18" respectively. Both VRPs 10'" and 10"" feed 
the storage device 36 and create two duplicate files of the same video, one with a 
high frame rate and the other with a low frame rate. 
5 The disclosed system and method enables control of the video speed 

in various components of a surveillance and storage system and the adaptation to 
the bandwidth transmitted to the viewers thereby making it Internet ready. The 
system and method further enables multi track recording on a storage device at 
various video frame rates and the distribution of a single video source to several 

10 viewers each with its own required video rate. 

The person skilled in the art will appreciate that what has been shown 
is not limited to the description above. The person skilled in the art will 
appreciate that examples shown here above are in no way limiting and serve to 
better and adequately describe the present invention. Those skilled in the art to 

15 which this invention pertains will appreciate the many modifications and other 
embodiments of the invention. It will be apparent that the present invention is not 
limited to the specific embodiments disclosed and those modifications and other 
embodiments are intended to be included within the scope of the invention. 
Although specific terms are employed herein, they are used in a generic and 

20 descriptive sense only and not for purposes of limitation. Persons skilled in the 
art will appreciate that the present invention is not limited to what has been 
particularly shown and described hereinabove. Rather the scope of the present 
invention is defined by the claims, which follow. 
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CLAIMS 

I/WE CLAIM: 

1. A system for the automatic unit rate control of at least one information 
units stream, the system comprising at least one information units stream 
processor device to receive at least one information units stream from at 
least one information units stream generating device, to selectively control 
the outputted unit rate of at least one information units stream and to 
output the at least one unit rate controlled information unit stream to at 
least one information units stream display device. 

2. The system as claimed in claim 1 wherein the at least one information unit 
stream processor device further comprises the elements of: 

at least one inputted information units stream having a pre-defined unit 
rate and carrying distinct information units; 

at least one input handling entity to receive the at least one inputted 
information units stream and to store selectively at least one information 
unit into at least one storage area; 

at least one storage area to hold at least one information unit received 
from the at least one input handling entity; 

at least one output handling entity to obtain at least one information unit 
from the at least one storage area to regulate the unit rate of an at least one 
information units stream and to output the at least one information units 
stream; and 

at least one information unit rate control mechanism to provide automatic 
unit rate control in order to regulate the unit rate of the at least one 
outputted information units stream. 

3. The system as claimed in claim 2 wherein the at least one information unit 
stream is inputted from at last one information units stream generator 
device. 
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4. The system as claimed in claim 2 wherein the at least one information 
units stream is outputted to at least one information unit stream display 
device. 

5. The system as claimed in claim 2 wherein the information units stream 
includes rich media. 

6. The system as claimed in claim 1 wherein the at least one information 
units stream is a video stream. 

7. The system as claimed in claim 1 wherein the at least one information unit 
is a video frame. 

8. The system as claimed in claim 3 wherein the at least one information unit 
stream generator device is a surveillance video camera device. 

9. The system as claimed in claim 4 wherein the at least one information 
units stream display device is a surveillance video monitor. 

10. The system as claimed in claim 1 wherein the information units stream 
' l processor device is a video rate processor device. 

1 1 . The system as claimed in claim 1 wherein the video rate processor device 
is operative in the selective unit rate control of an at least one video stream 
received from at least one surveillance video camera via the 
communication media and forwarded to at least one surveillance video 
monitor via a communication media. 

12. The system as claimed in claim 2 wherein the at least one input handling 
entity is a standalone hardware device. 
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13. The system as claimed in claim 2 wherein the at least one input handling 
entity is a software routine. 

14. The system as claimed in claim 2 wherein the at least one output 
handling entity is a standalone hardware device.- 

15. The system as claimed in claim 2 wherein the at least one output handling 
entity is software routine. 

16. The system as claimed in claim 2 wherein the unit rate control of the at 
least one outputted information units stream is further regulated internally 
by synchronized timing mechanism associated with the at least one output 
handling entity. 

! 

17. The system as claimed in claim 16 wherein the unit rate control of the at 
least one outputted information units stream is further controlled by 
associated meta-data. 

18. The system as claimed in claim 17 wherein the unit rate control of the at 
least one outputted information unit stream is further regulated by the pre- 
defined characteristics of the at least one output handling entity. 

19. The system as claimed in claim 18 wherein the unit rate control of the at 
least one outputted information units stream is further regulated by the 
pre-defined characteristics of the communication media. 

20. The system as claimed in claim 2 wherein the at least one storage area is 
implemented on a media storage device. 
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21. The system as claimed in claim 20 wherein the media storage device is a 
hard disk device. 



22. The system as claimed in claim 21 wherein the media storage device is a 
tape device. 

* 23. The system as claimed in claim 22 wherein the media storage device is a 
digital versatile disc device. 

24. The system as claimed in claim 5 wherein the communication media is the 
Internet. 

25. The system as claim in claim 24 wherein the communication media is an 
Intranet network. 

26. The system as claimed in claim 25 wherein the communication media is a 
wireless communication network. 

27. The system as claimed in claim 26 wherein the communication media is a 
local or wide area network. 

28. A method for the automatic unit rate control of at least one information 
units stream, the method comprising the steps of: 

receiving at least one information units stream having a pre-defined unit 

rate from at last one information unit generator device via a 

communication media by an at least one input handling entity; 

storing at least one information unit from the at least one information units 

stream into at least one storage area by the at least one input handling 

entity; 
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reading the at least one information unit from the at least one storage area 
by an at least one output handling entity, and 

controlling the operation of an at least one output handling entity by an at 
least one unit rate control mechanism to provide for a specific unit rate of 
the outputted information units stream. 

29. The method of claim 28 further comprising the step of outputting an at 
least one information units stream having a controlled specific unit rate by 
the at least one output handling entity to an at least one information units 
stream display device via the communication media. 

30. The method as claimed in claim 28 wherein the unit rate of the at least one 
outputted information units stream generated by the at least one output 
handling entity is controlled by an in-built timing mechanism associated 
with the at least one output handling entity. 

31. The method as claimed in claim 28 wherein the unit rate of the at least one 
outputted information units streams is further controlled the pre-defined 
characteristics of the at least one output handling entity. 

32. The method as claimed in claim 28 wherein the unit rate of the at least 
one outputted information units streams is further controlled the pre- 
defined characteristics of the transmission media. 

33. A method for generating a plurality of information units streams, 
provided with diverse unit rates, from at last one single information units 
stream having a pre-defined unit rate and distributing the plurality of the 
information unit streams, the method comprising the steps of: 
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inputting the at least one information units stream from an at least one 
information units stream generator device to a plurality of information 
units rate control devices; 

controlling the operation of the plurality of information units rate control 
devices via a plurality of unit rate control mechanisms in order to provide 
diverse unit rates to a plurality of outputted information units streams; 
storing the plurality of outputted information units streams into a plurality 
of data storage files associated with at least one media storage device; 
thereby creating a plurality of information units stream data storage files 
with variable unit rate characteristics. 

34. The method as claimed in claim 33 further comprising transmitting the 
plurality of the data storage files to a plurality of information units stream 
display devices in accordance with available communication bandwidth.. 

35. The method as claimed in claim 33 wherein the process for the generation 
of the data storage file is automatically controlled by and associated with 
the occurrence of at east one environmental event. 

36. The method as claimed in claim 33 wherein the transmission of a specific 
data storage file to the information units stream display device is 
controlled by and associated with the occurrence of at least one 
environmental event. 

37. The method as claimed in claim 33 wherein the transmission of the data 
storage files storing information units streams having diverse unit rate 
characteristics to at least one information units stream display device is 
controlled by and associated with the occurrence of at least one 
environmental event. 
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38. The method as claimed in claim 33 wherein the occurrence of the at least 
one environmental event and the lack thereof effect pre-defined, content- 
specific, unit-rate-specific and timed interactions among the data storage 
files. 

39. The method as claimed in claim 33 wherein the data storage files are 
short-term buffer storage files. 

40. The method as claimed in claim 39 wherein the data storage files are 
long-term archive storage files. 

41. The method as claimed in claim 39 wherein the short-term buffer storage 
files are operative in the distribution of the recorded information units 
stream in real time, p 

42. The method as claimed in claim 40 wherein the long-term archive files are 
operative in the distribution of the recorded information units stream off- 
line. 
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